CITED BY APPLICANT' 



UK Patent Application m GB Wl 2 394 138 A 



(43) Date of A Publication 14.04.2004 



(21) 


Application No: 


0321216.4 


(51) 


INT CL 7 : 








H04IM 5/21 // G06T5/20 


(22) 


Date of Filing: 


10.09.2003 








(52) 


t 11/ A| IP J|.|._ 111 1. 

UK CL (Edition W ): 


(30) 


Priority Data: 






H4F FHHB 




(31) 10242516 (32) 12.092002 


(33) FR 










(56) 


Documents Cited: 








JP 2002027324 A US 4376289 A 


(71) 


Applicant(s): 










Thomson Licensing S.A. 




(58) 


Field of Search: 




(Incorporated In France) 






UK CL (Edition W ) H4F 




46 Quai A.Le Gallo, 






INT CL 7 GOfiT. H04N 




F-92100 Boulogne-Billancourt, France 






Other. Online: EPODOC, WPI, PAJ 


(72) 


Inventor(s): 










Andreas Loew 








(74) 


Agent and/or Address for Service: 










Williams Powell 










Morley House, 26-30 Holborn Viaduct, 










LONDON. EC1A 2BP, United Kingdom 









(54) Abstract Title: Correction of video signals to reduce segment boundary visibility 



(57) In a method for the correction of video signals whose 

processing is distributed between a plurality of segments 
having different transfer characteristics, It is provided that, 
from values in each case of a predetermined number of 
pixels v r v 5 before the boundary of two segments, the value 
of at least one pixel v6' lying after the boundary is estimated 
in each case, and that correction values are derived from 
differences a1 between the at least one estimated value and 
the actual value of the at least one pixel of the following 
segment that lies after the boundary. 
An Independant claim is included for the method of 
producing the estimated pixel value from summed 
derivatives produced from differences between adjacent 
pixels. 
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Correction of Video Signals 

5 

The invention relates to a method and an arrangement 
for the correction of video signals whose processing is 
distributed between a plurality of segments having 
different transfer characteristics. 

10 

In order to obtain a higher resolution or number of 
pixels, linear-array optoelectronic transducers are 
composed of a plurality of segments, preferably two 

15 segments. Both the actual optoelectronic transducers 
themselves and the circuits for reading out and 
amplifying the video signals exhibit manufacturing 
tolerances which affect the linearity, the gain and an 
offset (black value) . This means that the various 

2 0 segments of an electronic transducer applied on an 
integrated circuit also have different transfer 
characteristics. At the boundary between two segments, 
in particular, these differences may be visible, and 
thus disturbing, during the reproduction of films or 

25 other scanned pictures. 

A correction of video signals exhibiting errors of this 
type is performed in the method according to the 

30 invention by virtue of the fact that, from values in 
each case of a predetermined number of pixels before 
the boundary of two segments, the value of at least one 
pixel lying after the boundary is estimated in each 
case, and that correction values are derived from 

35 differences between the at least one estimated value 
and the actual value of the at least one pixel of the 
following segment that lies after the boundary. 

The errors mentioned in the introduction can be 
40 automatically corrected by the method according to the 



invention, so that no differences between the segments 
are discernible in the reproduced picture. In the 
present connection, value is tantamount to "sample" . 

5 In the method according to the invention, it is 
preferably provided that only differences which do not 
exceed a predetermined value are used for forming the 
correction values. This prevents signal jumps which 
reproduce edges actually present in the picture from 
10 influencing the formation of the correction values. 

For the further connection of disturbing signal jumps 
in the region of the boundary, it may be provided that, 
furthermore, the differences are only used for forming 
15 the correction values if differences in the values of 
the predetermined number of pixels before the boundary 
are less than a predetermined value. 

One development of the method according to the 
20 invention consists in the fact that the differences, 
for the purpose of forming the correction values, are 
averaged separately according to the respective values 
of the video signals. This development enables the 
correction of linearity errors in an advantageous 
25 manner. 

The method according to the invention can already ■ be 
employed advantageously if only the width [sic] of the 
pixels on one side of the boundary are used for 
30 estimating the values of the pixels on the other side. 

A more accurate formation of the correction signals 
results, however, with the aid of one development of 
the method according to the invention by virtue of the 
35 fact that the temporal order of the predetermined 
number of pixels after the boundary of two segments is 
interchanged in each case, that the value of the at 
least one last pixel before the boundary is estimated 
from the interchanged values, that further differences 
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are formed from the value estimated for the at least 
one last pixel lying before the boundary and the actual 
value of the at least one last pixel lying before the 
boundary, that an average value is in each case formed 
5 from the differences and the further differences, and 
that the correction value is derived from the average 
values . 

This development may preferably be configured in such a 
10 way that the differences and the further differences 
are in each case subtracted from one another, and that 
the respective average value of the differences is only 
used for correction if the value produced by 
subtraction of the difference and the further 
15 difference is less than a further predetermined value. 
As a result, estimated values are also precluded from 
use for forming the correction values if the two 
estimates lead to significantly different results, 
which may possibly be the case in the region of edges. 

20 

In this development, too, the correction signals can be 
formed separately according to values in particular by 
virtue of the fact that the average values of the 
differences, for the purpose of forming the correction 
25 values, are averaged separately according to the 
respective values of the video signals. / 

In principle, the method according to the invention 
makes it possible to correct the signals of one of the 

30 segments and thus adapt them to the signals of the 
respective other segment. To that end, in one 
development of the invention it is provided that the 
correction values are written to a memory, and that the 
correction values, depending on the respective values 

35 of the video signals of at least one segment to be 
corrected, are read from the memory and applied to the 
video signals of the at least one segment to be 
corrected. 
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The method according to the invention also enables the 
two adjoining segments to be corrected to an extent 
such that they match one another. To that end, in 
another development it is provided that the correction 
5 values are written to a memory, and that the correction 
values, depending on the respective values of the video 
signals, are read from the memory and added half each 
with an opposite sign to the values of the video 
signals of the adjoining segments. 

10 

The estimation of the value of the pixel respectively 
lying on the other side of the boundary may • preferably 
be effected by virtue of the fact that a first 
derivative of the video signal is formed by difference 

15 formation between values of in each case two adjacent 
pixels of n pixels, that a second derivative is formed 
by difference formation of the values of the first 
derivative, up to a (n-l)th derivative, and that the 
values of all the derivatives are added and form the 

20 estimated value for a following pixel. This method is 
also suitable for estimations other than in the method 
according to the main claim. 

25 An exemplary embodiment of the invention is illustrated 
in the drawing on the basis of several figures .and 
explained in more detail in the description below/ In 
the figures: 

30 Figure 1 schematically shows an optoelectronic linear- 
array sensor, 

Figure 2 shows a diagram with values of pixels on both 
sides of the boundary, 

35 

Figure 3 shows a block diagram of an arrangement for 
carrying out the method according to the invention, and 



Figure 4 shows a block diagram of a predictor used in 
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the invention. 

Although the exemplary embodiment and parts thereof are 
illustrated as block diagrams, this does not mean that 
5 the arrangement according to the invention is 
restricted to a realization with the aid of individual 
circuits corresponding to the blocks. Rather, the 
arrangement according to the invention can be realized 
particularly advantageously with the aid of large scale 
10 integrated circuits. In this case, it is possible to 
use digital signal processors which, given suitable 
programming, carry out the processing steps illustrated 
in the block diagrams. 

15 

Figure 1 shows, in highly schematic form, a linear 
optoelectronic transducer of the kind used in film 
scanners, in which a line of optical sensors is 
composed of two segments 2, 3. The charges respectively 

20 corresponding to the brightness of a pixel are 
transmitted in parallel from the individual sensors 
into registers 4, 5, 6, 7 and are read serially from 
the latter. In this case, one of the registers 4 and 5, 
and 6 and 7, respectively, is used pixel by pixel in 

25 multiplex. However, an explanation of this multiplex 
method is not necessary for an understanding of the 
present invention. 

At the outputs of the registers 4, 5, 6, 7 there are 
30 analogue amplifiers 8, 9, 10, 11, from the outputs of 
which the signals are fed to analogue/digital 
converters 13, 14 (Figure 3). 

The transfer characteristics of the segments 2, 3 and 
35 of the downstream circuits 4 to 11 differ from one 
another due to manufacturing tolerances. These 
differences may concern nonlinearities, gain factors or 
offsets and are essentially visible at the boundary 12 
of the two segments 2, 3. 
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In order to correct these errors, two predictor filters 
21, 22 - also called predictor for short hereinafter - 
are provided in the exemplary embodiment according to 
5 Figure 3 . An exemplary embodiment of a predictor is 
specified in Figure 4. The method of operation of the 
predictors is explained with the aid of the diagram in 
accordance with Figure 2. Both filters evaluate pixels 
in the vicinity of the boundary 12 (Figure 1) , the 

10 predictor 21 evaluating the (temporally) last pixels of 
the first segment 2 and the predictor 22 evaluating the 
first pixels of the second segment 3. In order to 
enable a conclusion to be drawn about the last pixel of 
the first segment with the aid of the predictor 22, a 

15 buffer memory 23 (Figure 3) is connected upstream of 
the predictor 22 , which buffer memory performs a 
temporal interchanging of the pixels 1 to n. 

It shall be assumed that five pixels with the values 
20 vl, v2 , v3 , v4 and v5 are read from the segment 2 
(Figure 1) before the boundary 12. From the profile of 
these values, the value of the first pixel v6' lying 
after the boundary 12 is deduced. Since this value is 
only estimated, it is represented as a circle in 
25 Figure 3 in contrast to the rest of the values, which 
are represented by circular discs. 

The illustration likewise shows five of the signals 
read from the segment 3, namely the pixels numbered n 
30 to n-4, but in a temporally interchanged order. The 
values of these pixels are specified by v6 to vlO. 
Since no junqp is to be assumed at the boundary 12 in 
the case of the video signal profiles illustrated, the 
difference v6'-v6 can be regarded as an error. 

35 

Influences governed by the picture content are 
minimized by continuous application of the estimations 
and of the calculations of the difference v6'-v6 and 
averagings of this difference. Moreover, differences 
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v6'-v6 are not used for forming the correction signal 
if these differences or one of the differences between 
the preceding pixels is greater than a predetermined 
value. This predetermined value is somewhat greater 
5 than the maximum expected error. It is thus possible to 
prevent grossly incorrect estimations at jumps of the 
video signal. 

The accuracy can be improved in that, with the aid of 
10 the predictor 22 (Figure 3) , the values v6 to vlO are 
used to estimate the value v5' of the last pixel lying 
before the boundary 12. The difference is likewise 
formed between said value v5' and the actual value v5. 
Averaging the two differences produces a more accurate 
15 measure of the deviation. 

The deviations determined upon each pass through the 
boundary 12 are continuously averaged separately 
according to amplitude levels, so that after some time 
20 a histogram is produced which largely represents the 
differences in the transfer characteristics of the two 
segments from temporal and spatial conditions of the 
picture content. 

25 In order to produce the histogram, in accordance with 
Figure 3, the procedure is as follows. As already 
mentioned, the predictors 21, 22 generate an estimated 
value p for the pixel respectively lying on the other 
side of the boundary, a propagation-time-adapted value 

30 v of the video signal and difference values d between 
the individual pixels. The difference values d are fed 
to comparators 26, 27, which respectively generate an 
enable signal Ql, Q2 for the further processing only 
when the largest difference value d is less than the 

35 predetermined value Kl . 



The estimated values p and the values v are forwarded 
crosswise to a respective subtractor 28, 29, at the 
output of which the difference values al and a2 are 
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present. The latter are fed to an averaging unit 30, 
the output of which carries the average value a from 
the difference values al and a2 . Moreover, the 
difference values al and a2 pass to a further 
5 subtractor 31 followed by a comparator 32. The latter 
forwards an enable signal Q3 only when the difference 
between the two difference values al and a2 is less 
than a predetermined value. This likewise prevents 
signal profiles which are not suitable for an 
10 estimation in the sense of the invention from being 
used to form the correction signals. 

The value v, the average a of the difference values and 
the enable signals Ql to Q3 are forwarded to an 
15 accumulator 33 , which accumulates the average values a 
separately for each range of values of v if the enable 
signals Ql to Q3 are present. In this case, the 
frequency of occurrence is furthermore counted 
depending on the range of values of v. 

20 

In a subsequent accumulator 34, all a are accumulated 
separately according to values v. Moreover, the number 
c of accumulated a is counted for each value v. Only 
those a for which the enable signals Ql to Q3 are 
25 present participate in this. 

The accumulated values ac (v) and the associated counts 
c(v) are transmitted to an interpolator 34, in which 
the values ac(v) respectively divided by c (v) are 

30 interpolated to produce a correction curve from which 
random discontinuities have been eliminated. Values 
ac(v) for which c (v) is less than a predetermined limit 
value are not taken into account in this case. The 
interpolated values are stored in a table 35 under 

35 addresses corresponding to the values v. 

In order to correct the values read from the segments 
2, 3 (Figure 1), said values are then fed as addresses 
to the table 35, whereby the correction values stored 



under the respective address are then added to the 
signals in a manner correct in respect of sign by means 
of a respective multiplier 36, 37 and an adder 38, 39. 
Corrected video signals are then available at the 
5 outputs 40, 41. 

Figure 4 shows a predictor in which the digital video 
signals arriving at an input 51 are delayed in each 
case by a pixel period with the values v(0) to v(n) 

10 with the aid of registers 52 to 55 clocked with the 
pixel clock. The difference is formed in each case 
between two successive values with the aid of 
subtractors 56 to 59. Further subtractors 60, 61, 62 in 
turn form differences from the differences. This 

15 process is continued with the subtractors 63 and 64 and 
a final subtractor 65. In a summing circuit 66, the 
output signals of the subtractors 56, 60, 63, 65 are 
summed and the sum is fed to an output 67 as estimated 
value p(n+l) . Moreover, the video signal is forwarded 

20 unchanged to an output 68. The value v(n) is available 
at the point in time considered. 

The estimated value p(n+l) is forwarded to a subtractor 
70 after having been delayed by a pixel period at 69 
25 and is subtracted from v(n) at said subtractor. This 
produces a difference value d(n) , which can be tajcen 
from the output 75. Through delays 71 to 74, the 
preceding differences are made available at the outputs 
76 to 79. 

30 
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Claims 



1. Method for the correction of video signals whose 
processing is distributed between a plurality of 
5 segments having different transfer characteristics, 
characterized in that, from values in each case of a 
predetermined number of pixels before the boundary of 
two segments, the value of at least one pixel lying 
after the boundary is estimated in each case, and that 
10 correction values are derived from differences between 
the at least one estimated value and the actual value 
of the at least one pixel of the following segment that 
lies after the boundary. 

15 2. Method According to Claim 1, characterized in that 
only differences which do not exceed a predetermined 
value are used for forming the correction values. 

3. Method according to Claim 2, characterized in 

20 that, furthermore, the differences are only used for 

forming the correction values if differences in the 

values of the predetermined number of pixels before the 
boundary are less than a predetermined value. 

25 4. Method according to one of Claims 1 to 3, 
characterized in that the differences, for the purpose 
of forming the correction values, are averaged 
separately according to the respective values of the 
video signals. 

30 

5. Method according to one of the preceding claims, 
characterized in that the temporal order of the 
predetermined number of pixels after the boundary of 
two segments is interchanged in each case, in that the 
35 value of the at least one last pixel before the 
boundary is estimated from the interchanged values, in 
that further differences are formed from the value 
estimated for the at least one last pixel lying before 
the boundary and the actual value of the at least one 
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last pixel lying before the boundary, in that an 
average value is in each case formed from the 
differences and the further differences, and in that 
the correction value is derived from the average 
5 values . 

6. Method according to Claim 5, characterized in that 
the differences and the further differences are in each 
case subtracted from one another, and in that the 
10 respective average value of the differences is only 
used for correction if the value produced by 
subtraction of the difference and the further 
difference is less than a further predetermined value. 

15 7. Method according to either of Claims 5 and 6, 
characterized in that the average values of the 
differences, for the purpose of forming the correction 
values, are averaged separately according to the 
respective values of the video signals. 

20 

8. Method according to one of the preceding claims, 
characterized in that the correction values are written 
to a memory, and in that the correction values, 
depending on the respective values of the video signals 

25 of at least one segment to be corrected, are read from 
the memory and applied to the video signals of the., at 
least one segment to be corrected. 

9. Method according to one of Claims 1 to 7, 
30 characterized in that the correction values are written 

to a memory, and in that the correction values, 
depending on the respective values of the video 
signals, are read from the memory and added half each 
with an opposite sign to the values of the video 
35 signals of the adjoining segments. 

10. Method for the estimation of the value of a pixel 
in a video signal, characterized in that a first 
derivative of the video signal is formed by difference 



- 12 - 

formation between values of in each case two adjacent 
pixels of n pixels, in that a second derivative is 
formed by difference formation of the values of the 
first derivative, up to a (n-l)th derivative, and in 
5 that the values of all the derivatives are added and 
form the estimated value for a following pixel, 

11. A method for the correction of video signals 
substantially as herein described with reference to 
10 Figures 3 and 4 of the accompanying drawings. 
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